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Abstract 

Stochastic maximum principle of nonlinear controlled forward-backward 
systems, where the set of strict (classical) controls need not be convex and 
the diffusion coefflcient depends explicitly on the variable control, is an 
open problem impossible to solve by the classical method of spike varia- 
tion. In this paper, we introduce a new approach to solve this open prob- 
lem and we establish necessary as well as sufficient conditions of optimal- 
ity, in the form of global stochastic maximum principle, for two models. 
The first concerns the relaxed controls, who are a measure- valued pro- 
cesses. The second is a restriction of the first to strict control problems. 
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1 Introduction 

We study a stochastic control problem where the system is governed by a non- 
linear forward-backward stochastic differential equation (FBSDE for short) of 
the type 

dx'"t ^b{t,x^t,Vt)dt + a{t,x^t,vt)dWt, 
' dl^ = -f (t, y,", vt) dt + z-dWu 

where b, cr, / and ip are given maps, W = (Wt)f^Q is a standard Brownian 
motion, defined on a filtered probability space ^il, J-", (jF4)j>q , 'P^ , satisfying 
the usual conditions. 
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The control variable v = (vt), called strict (classical) control, is an 
adapted process with values in some set U of R'^. We denote by U the class of 
all strict controls. 

The criteria to be minimized, over the set U, has the form 



where g, h and I are given functions and {x1,y^,z^) is the trajectory of the 

system controlled by v. 

A control u €U is called optimal if it satisfies 



The objective of this kind of stochastic control problem is to obtain the op- 

timality conditions of controls in the form of Pontryagin stochastic maximum 
principle. There is many works on the subject, including Peng [42], Xu [47], Wu 
[46], Shi and Wu [44], Ji and Zhou [30], BahlaU and Labed [5] and Bahlali [8]. 
All the previous results on stochastic maximum principle of forward-backward 
systems are established in the cases where the control domain is convex or un- 
controlled diffusion coefficient. The general case, where the set of strict controls 
need not be convex and the diffusion coefficient depends explicitly on the con- 
trol variable, is an open problem unsolved until now. There is no result in the 
literature concerning this problem and the classical way which consists to use 
the spike variation method on the strict controls docs not lead to any result. 
The approach developed by Peng [41] to solve the similar case of controlled 
stochastic differential equations (SDEs) cannot be applied in the case of con- 
trolled FBSDEs. Indeed, since the control domain is not necessarily convex and 
the diffusion a depends on the control variable, the classical way of treating 
such a problem would be to use the spike variation method on the strict con- 
trols and to introduce the second-order variational equation. But, the FBSDE 
system depends on three variables {x, y and z) and the second order expansion 
leads to a nonlinear problem. It is impossible to deduce then the second-order 
variational inequality. 

In this paper, we solve this open problem by using the new approach devel- 
oped by Bahlali [7] . We introduse then a bigger new class TZ of processes by 
replacing the [/-valued process (vt) by a P (C/)-valued process (qt), where P (f/) 
is the space of probability measures on U equipped with the topology of stable 
convergence. This new class of processes is called relaxed controls and have a 
richer structure of convexity, for which the control problem becomes solvable. 
The main idea is to use the property of convexity of the set of relaxed controls 
and treat the problem with the method of convex perturbation on relaxed con- 
trols (instead of that of the spike variation on strict one). We establish then 
necessary and sufficient optimality conditions for relaxed controls and we derive 
directly the optimality conditions for strict controls from those of relaxed one. 




J (u) = inf J {v) . 
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In the relaxed model, the system is governed by the FBSDE 



dxf = Sijb {t, xl, a) Qt {da) dt + J^a {t, x^, a) qt {da) dWt, 



dy! 



■ lu f (t' , yl, zl, a) qt {da) dt + z^dWt, 



y^ = (p {x^) . 

The functional cost to be minimized, over the class TZ of relaxed controls, is 
defined by 



J{q)=^ 



g {x^t) + h {y^) + I I l{t,xl,yl,zl,a)qt{da) 
Jo Ju 



dt 



A relaxed control fj, is called optimal if it solves 

J{n)=MJ{q). 

The relaxed control problem is a generalization of the problem of strict 
controls. Indeed, if qt {da) = 6y^ {da) is a Dirac measure concentrated at a 
single point Vt S U, then we get a strict control problem as a particular case of 
the relaxed one. 

To achieve the objective of this paper and establish necessary and sufficient 
optimality conditions for these two models, we proceed as follows. 

Firstly, we give the optimality conditions for relaxed controls. The idea is 
to use the fact that the set of relaxed controls is convex. Then, we establish 
necessary optimality conditions by using the classical way of the convex pertur- 
bation method. More precisely, if we denote by fi an optimal relaxed control 
and q is an arbitrary element of TZ, then with a sufficiently small 9 > and for 
each t G [0,T], we can define a perturbed control as follows 

fif = fit + e {qt - lit) ■ 

We derive the variational equation from the state equation, and the varia- 
tional inequality from the inequality 

0< 

By using the fact that the coefficients b, a, f and I are linear with respect 
to the relaxed control variable, necessary optimality conditions are obtained 
directly in the global form. 

To enclose this part of the paper, we prove under minimal additional hy- 
pothesis, that these necessary optimality conditions for relaxed controls are also 
sufficient. 

The second main result in the paper characterizes the optimality for strict 
control processes. It is directly derived from the above result by restrict- 
ing from relaxed to strict controls. The idea is to replace the relaxed con- 
trols by a Dirac measures charging a strict controls. Thus, we reduce the set 
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TZ of relaxed controls and we minimize the cost over the subset 5 {U) = 
{q &TZ I q = 5y ; v €U}. Necessary optimality conditions for strict con- 
trols are then obtained directly from those of relaxed one. Finally, we prove 
that these necessary conditions becomes sufficient, without imposing neither 
the convexity of U nor that of the Hamiltonian H in v. 

This paper can be also regarded as an extension of that of Bahlali [7] to the 
forward-backward systems. Indeed, if we consider only the forward equation, 
without the backward one {y = z = f = h = 0), we recover then exactly all the 
results of [7] . 

The paper is organized as follows. In Section 2, we formulate the strict and 
relaxed control problems and give the various assumptions used throughout 
the paper. Section 3 is devoted to study the relaxed control problems and 
we establish necessary as well as sufficient conditions of optimality for relaxed 
controls. In the last Section, we derive directly from the results of Section 3, 
the optimality conditions for strict controls. 

Along this paper, we denote by C some positive constant, Mnxd{^) the 
space of n X d real matrix and A^^^n (^) linear space of vectors M = 
(Ml, Md) where Mj G Mnxn {^)- We use the standard calculus of inner and 
matrix product. 



Let yfl,J-, {^t)t>{) t'Pj be a filtered probability space satisfying the usual con- 
ditions, on which a d-dimensional Brownian motion W = {Wt)f^Q is defined. 
We assume that {J^t) is the V- augmentation of the natural filtration of W. 
Let T be a strictly positive real number and U a non-empty set of R'^. 

2.1 The strict control problem 

Definition 1 An admissible strict control is an J-f— adapted process v = (vt) 
with values in U such that 



2 Formulation of the problem 



E sup Ivtl^ < oo. 
te[o,T] 



We denote by U the set of all admissible strict controls. 



For any v €lJ, we consider the following controlled FBSDE 



dx^t =b{t,x^,Vt)dt + a{t,x^,Vt)dWt 



dyl = -f (t, x\,yl, zl, Vt) dt + z^dWt 



(1) 
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where, 



[0,T] X M" X J7 — >W, 

[0,T]xR"xf/^A^„xd( 
[0,T] xR" xM'" X Al^xdl 



X U 



and X is an n— dimensional J-Q-measurable random variable such that 

E\xf < 00. 

The criteria to be minimized is defined from U into M. by 



J{v)=E 



g (x^) + h + ri {t, z^, Vt) dt 

Jo 



(2) 



where, 
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I : [0, T] X M" X X Mmxd (R) x U 
A strict control u is called optimal if it satisfies 

J{u)=m{J{v). 



(3) 



We assume that 

b, (7, f, g, h, I and ip are continuously differentiablc with respect (4) 
to (x, y, z) , they arc boimdcd by C (1 + \x\ + \y\ + \z\ + \v\) and their 
derivatives with respect to {x, y, z) are continuous in (x, y, z, v) 
and uniformly bounded. 

Under the above hypothesis, for every v € U, equation (1) has a unique 
strong solution and the functional cost J is well defined from U into M. 

2.2 The relcixed model 

The idea for relaxed the strict control problem defined above is to embed the 
set U of strict controls into a wider class which gives a more suitable topological 
structure. In the relaxed model, the ?7-valued process v is replaced by a P (C/)- 
valued process q, where P (U) denotes the space of probability measure on U 
equipped with the topology of stable convergence. 

Definition 2 A relaxed control {qt)t a ¥ [U) -valued process, progressively 
measurable with respect to {J-'t)t and such that for eacht, l]o,t]-9 is J-'t-measurable. 
We denote by TZ the set of all relaxed controls. 
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Remark 3 Every relaxed control q may be desintegrated as q {dt, da) = q {t, da) dt • 
qt (da) dt, where qt {da) is a progressively measurable process with value in the 
set of probability measures F{U). 

The set U is embedded into the set TZ of relaxed process by the mapping 

f -.v G U\ — >fy {dt, da) = Sy^ {da)dt e TZ 

where 6y is the atomic measure concentrated at a single point v. 



For more details on relaxed controls, see [4] , [6] , [7] , [16] , [21] , [34] , [37] , [38] . 

For any q E TZ, we consider the following relaxed FBSDE 

dxl = Jjjb {t, xl, a) qt {da) dt + j^a {t, xl, a) qt (da) dWt, 

(5) 



dyl = - luf ' Vh 4^ o) Qt {da) dt + zfdWt, 
y^ = ^ {x^j.) . 



The expected cost to be minimized, in the relaxed model, is defined from TZ 
into M by 



g{x^j,) + h{y^)+ I I l{t,x'l,yl,z1,a)qt{da)dt 
Jo Ju 



A relaxed control is called optimal if it solves 

J{n)=m{J{q). 

Remark 4 // we put 

b{t,x1,qt)= b{t,xl,a)qt{da) , 
Ju 

'^{t,xl,qt)= / cr{t,x'l,a)qt{da) , 
Ju 

7 {t, xl, yt, zl, a)= f {t, xl, yl, z1, a) qt {da) , 
Ju 

I {t, xl,yl, zl, a)= I {t, xl,y1, z^, a) qt {da) . 



Then, equation (5) becomes 



dxl = b {t, xl, qt) dt + a {t, xl, qt) dWt 



dyl = -f {t, xl, yl zl qt) dt + z^dWt, 
^ y^ = ip {x^) . 



(6) 



(7) 



With a functional cost given by 



J(<?)=E 



5 (4) + /i + / l{t,xlylz1,qt)dt 
Jo 



Hence, by introducing relaxed controls, we have replaced U by a larger space 

F{U). We have gained the advantage that ¥ (U) is and convex. Furthermore, 
the new coefficients of equation (5) and the running cost are linear with respect 
to the relaxed control variable. 

Remark 5 The coefficients b,a and f (defined in the above remark) check re- 
spectively the same assumptions as b,a and f. Then, under assumptions (4), 
6, and f are uniformly Lipschitz and with linear growth. Then by classical 
results on FBSDEs, for every q € TZ equation (5) has a unique strong solution. 

On the other hand, It is easy to see that I checks the same assumptions as 
I. Then, the functional cost J is well defined from TZ into R. 

Remark 6 If qt = S^^ is an atomic measure concentrated at a single point 
Vt € U , then for each t G [0, T] we have 

/ b{t,xl,a)qt{da) = / b{t,x^,a)5y^{da) = b{t,x^t,Vt) , 
Ju Ju 

/ a{t,x1,a)qt{da) = / a {t,xf,a) {da) = a {t,xf,vt) , 
Ju Ju 

/ f{t,x^,y^,zl,a)qt{da)= / f {t,x^,y^,z^,a)Sy,{da) = f {t,x^,y^,zlvt) , 
Ju Ju 

/ l{i^xl,yl,z1,a)qt{da) = / I {t, x'^,y1 , z^ , a) 6y^ {da) = I {t,x1,y^ , z^ ,vt) . 
Ju Ju 

In this case {x'^,y'^,z'^) = {x" ,y'" ,z"), J {q) = J {v) and we get a strict 
control problem. So the problem of strict controls {(1) , (2) , (3)} is a particular 
case of relaxed control problem {(5) , (6) , (7)}. 

Remark 7 The relaxed control problems studied in El Karoui et al [16] and 
Bahlali, Mezerdi and Djehiche [4] is different to ours, in that they relax the 
corresponding infinitesimal generator of the state process, which leads to a mar- 
tingale problem for which the state process driven by an orthogonal martingale 
measure. In our setting the driving martingale measure qt {da) dWt is however 
not orthogonal. See Ma and Yong [34] for more details. 



3 Optimality conditions for relaxed controls 

In this section, we study the problem {(5) , (6) , (7)} and we estabUsh necessary 
as well as sufficient conditions of optimality for relaxed controls. 
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3.1 Preliminciry results 

Since the set TZ is convex, then the classical way to derive necessary optimality 
conditions for relaxed controls is to use the convex perturbation method. More 
precisely, let ^ be an optimal relaxed control and {x'^,y'^, z^^) the solution of (5) 
controlled by fi. Then, for each t S [0, T] we can define a perturbed relaxed 
control as follows 

(4 = Ht + O {qt - lit) , 

where, ^ > is sufficiently small and q is an arbitrary element of TZ. 

Denote by (^x^,y^,z^) the solution of (5) associated with /i^. 
From optimality of /U, the variational inequality will be derived from the fact 
that 

0< 

For this end, we need the following classical lemmas. 
Lemma 8 Under assumptions (4), we have 



lim 

61^0 



lim 

61^0 



sup E |xj — Xf\ 

te[o,T] 

sup E\yf-yi^\ 
te[o,T] 



limE 



lE [ 
Jo 



-0, 
= 0, 
' dt = 0. 



(8) 

(9) 
(10) 



Proof. (8) is proved in [7, Lemm 9, page 2085] . 

Let us prove (9) and (10). 

Applying Ito's formula to (yf — ) , we have 



+2E 



E \y', - I' + E^^ \zt - z^fds = E |^ (4) - <p «)|' 

(s,a;f,yf,2;f,a)/if (da) - / f {s,xi^,y^, z^,a) /j., (da) 

Ju 



From the Young formula, for every e > 0, we have 

i-T 



■E 



m-yt\ 

<E|^(4) -^(ar^)|' + -E/ \yl - y>i\ 

^ Jt 



ds 



■£E 



( f{s,xlylzla)iil{da)- [ f{s,x^, 
u Ju 



y^,z^,a) Us {da) 



ds. 



ds. 
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Then, 



+ CeE 



+ CeE 



1 /""^ 
£ Jt 

[ f {s, xl yl zl a) til {da) - ( f {s,xl yl z^ a) {da 
Ju Ju 

f{s,xl,yl,zl,a)iJ.,{da)- / / (s,<,yf,^f,a) /Xs 
/ Ju 

f{s,x'i,yt,z^,,a)iJ,s{da)- / / (s, t/^, 2;f , a) /x« (da) 

/ Ju 

+ CsEr [ f{s,x^,y^,zla)tx,{da)- [ f {s,x^ ,y^,z^,a) fi^ {d> 
Jt Ju Ju 

By the definition of /if, we have 

E\yf-y;^\'+Ej'\zt-z^\'ds 

1 

<E\<f{x^T)->f{xT)\^ + -E \y'^^-y^\^ds 

^ Jt 

/ f {s,xl,y^,,z^,,a)qs{da) - / f {s,xl,y^,, zf,a) {da 
Ju Ju 



a) 



ds 

I 

ds 

2 

ds 
ds. 



+ Cee'^E 



ds 



+ CeE 



+ CeE 



ds 



ds. 



+ CeEf f f {s, xl, yl, z^ a) fi^ {da) - f f {s, x^, t/f , z^, a) m« {da) 
Jt Ju Ju 

f {s,x''^,yl,zl,a) Hs{da) - / f {s,x''^,y'^,zl,a) iis{da) 
1 Ju 

f{s,x'^,y^,z^^,a)ns{da)- / f {s,x'^,y^, z^,a) {da) 
J Ju 

Since and / are uniformly Lipschitz with respect to x,y,z, then 
E\yt-y>;\^+Ej^^\zt-z^fds< E \yt - y^\^ ds (11) 

+ C£EjJ' \z^^-z^\'^ds + at, 

where is given by 

af = E 14 - + CseJ^ \xl - x^l^ds + Cse^. 



By (8), we have 



lima? = 0. 



(12) 



Choose e = — , then (11) becomes 



E \yf - y^\' + - z^\'d8 < {2c + 1) E^^ |yf - y^\^ ds + a^ 

From the above inequality, we derive two inequahties 

E \yt - I' < (2c + E^^ |yf - ds + 

^£ \4 - ds < {AC + 1) e£ \y', -y^\^ds + 2al 



(13) 



(14) 



By using (12) , (13), Gronwall's lemma and Bukholder-Davis-Gundy inequal- 
ity, we obtain (9). Finally, (10) is derived from (9) and (12). ■ 

Lemma 9 Let Xt and yt are respectively the solutions of the following linear 
equations (called variational equations) 



dxt = 



u 
Ju 



bxit,x'^,a) iitida)xtdt+ / (t, x'^^ , a) (da) XtdWt 



, Xq= 0. 



b {t, , a) nt {da) - / 6 (t, x^, a) qt {da) 
Ju 

a {t, Xf , a) fit {da) — / a {t, x^ , a) qt {da 
Ju 



dt 

dWt, 



(15) 



dyt 



/ [fx {t, , yt, zj^, a) xt + fy {t, x^*, t/f , z^, a) yt + fz {t, xf , y^, z^, a) Zt] Ht {da) dt 

[ f{t,x>i,y>i,z>^,a)fxt{da)- [ f {t^x^ ,y>i ,z>i ,a) qt{da) 
Ju Ju 



V yT= fx {xt) XT- 
Then, the following estimations hold 



limE 

61^0 



limE 



Vt - Vt 



limE 

0^0 
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Xt 

-yt 

2 



Zt 



= 0, 
= 0, 
dt = 0. 



dt + ztdWt, 
(16) 

(17) 
(18) 
(19) 
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Proof. For simplicity, we put 



X? = ^Y^-xu (20) 
ye ^ ylz_i_ _ (21) 

Zt='^^-~zt. (22) 

Kl (a) = (i, + {Xt + 5?t) , + (F/ + ^t) , + (Z,^ + Zt) , a) . 

i) (17) is proved in [7, Lemma 10, Page 2086] 

ii) Proof of (18) and (19). 

By (21) and (22), we have the following FBSDE 

dYf = [FfYUt + FfZl - 7f ) at + ZtdWu 



where, 



Ff = - t I fy{At{a))fit{da)dX, 

Jq Ju 

F^ = - t [ MAt{a))fXt{da)dX, 
Jo Ju 



and 7^ is given by 

It JU 



lt= ! I h{^-l{a))Xl^i,{da)ds 
Jt Ju 

+ C i [U (K («)) {4 - ^0 + /. {K («)) {yt - y^) + h {K («)) {4 - z'i)] {da) ds 

U (Af (a)) (x^ - x^) + fy (A^ (a)) [yt - + /. (Af (a)) [z^ - z^)] /x, {da) ds. 



t Ju 

T 



t Ju 



Since f^, fy and fz are continuous and bounded, then from (8) , (9) , (10) 
and (17), we have 

limE|7f|^ = 0. (23) 
Applying Ito's formula to {Y^)^, we get 

E\Yf\'^ + E[ |Zf f ds = E|y^|%2E / |y/(Fj'y/ + F;z,^-7f)|rfs. 

Jt Jt 
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By using the Young formula, for every e > 0, we have 



E\Yf\ +E / ds <E\Y. 



lye 


2 1 

+ -E 
















lye 











s s 

t 



+ C£E^ IF^'Z"^]" ds + CeEj {Ysl" ds. 



i 



Since and are bounded, then 



where 



E|y/|"+Ej|' |zf|^ds< Q + CejE^ |y/fds + CeE^ | | ' ds + 

= E f + CeE^ |7f f ds. 



Choose £ = — , then we have 



2 1 



Z^Tds < ( 2C + 



\yt\ds^n\. 



From the above inequality, we deduce two inequalities 
E|F/r < ( 2C+ ' ' 



^ ds < (4C + l)E^ |F/fds + 27?^ 



On the other hand, we have 



E =E 



E 



(24) 
(25) 



/•I 2 
<2E/ |[<p^(a;^)-(p^(a;^ + A^(xT + ^T))]^T| 

+ 2e/" |<^^(a;^ + A6l(^T + XT))^Trf^A. 

By using (17) and the fact that is continuous and bounded, we get 

limElF^I^ =0. 



(26) 
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Prom (23) and (26), we deduce that 



lim?7? = 0. 



(27) 



Finally, by using (24) , (27), Gronwall's lemma and Bukholder-Davis-Gundy 
inequality, we obtain (18). Finally (19) is derived from (25) , (27) and (18). ■ 

Lemma 10 Let fi be an optimal control minimizing the functional J over TZ 
and {Xf,yf, z^) the solution of (1) associated with fi. Then for any q gTZ, we 
have 

0<E[g,{xi^)xT]+E[hy {y^)yo] 

i-T 



+ E 



u 



l{iix'i,y^,z'^,a)qt{da) - / I {t,x'i! ^y'^ , z't\a) fit (da) 



dt (28) 



+ E [ I lx{t, a;f , t/f , 2;f , a) fit {da) Xt+ [ ly {t, a;f , t/f , z^, a) fit {da) yt 
Jo Uu Ju 



dt 



■E 



Ju 



Iz {t, x'^,y^, , a) fit (da) Ztdt. 



Proof. Let fi be an optimal relaxed control minimizing the cost J over IZ, then 
we get 



< E [5 {x't) - g {x'i,)] +E[h {yl) - h (y^)] 



+ E 



(t, xlyl zl a) f4 {da) - [ l{t, , yf , z^, a) fit {da) 
Uu Ju 

= E[g {x'r) - g (a;^)] +E[h {y',) - h (y^^)] 

+ E / [ l{t,xt,yt, zt, a) f4 {da) - [ l{t,xt, yt, z^, a) fit {da) 
Jo Uu Ju 



-E 



T r 



I {t,Xt,y1,Zt,a) fit{da) - / I {t, x'^ ,y'^ , z^\ a) fit {da) 

Ju 

From the definition of fi^ , we get 
0<E[g (x^) - g «)] +E[h {y'o) - h {y^)] 

+ 9. 



dt 

dt 
dt. 



I {t,Xt,yt,zt,a) qt{da) - / I {t,Xt,yt,zt,a) fit{da) 

Ju 

+ e[ [ [l{t, xl yt, zt, a) - I {t, xf , yf , z^, a)] fit {da) dt. 
Jo Ju 



dt 
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Then, 



0<e/ [gx {xt^ + {xt + X^)) xt] dX (29) 
Jo 

+ E / [hy {y^ + \e {yo + Fo^) ) yo] dX 
Jo 

+ e[ [ [ [lx{Af{a))xt+ly{At{a))yt + k{At{a))zt]i^t{da)dXdt 
Jo Jo Ju 



+ E 



li't,x't\yi\z^' ,a)qt{da) - / I {t, x'^ ,y't , z'^ , a) fit (da) 



dt + pl 



where is given by 

pt=E[ [g^ {x!^ + Xe {xT + X^)) X^ dX 
Jo 

+ E / [hy {y^ + xe {yo + Fo') ) Yq] dX 

Jo 

+ E /7 [I, {At (a)) {xt - x^) + ly {At (a)) {yt - yf) + h (A? (a)) {z^ - z^)] qt {da) dXdt 
Jo Jo Ju 

{K (a)) {xt - x^) + ly {At (a)) {yt - yf) + /. (A? (a)) {zf - z^)] pt (da) dXdt 
[l, {At (a)) X^ + ly {At (a)) Yf + I, {At (a)) Z^] pt {da) dXdt. 



+ E 



Jo JU 
T pi 



+ E 



Jo Ju 



Since the derivatives gx, hy, Ix, ly and 1^ are bounded, then by using the 
Cauchy-Schwartz inequality, we have 



pt < c (e ) ^'"^ + c (e 



1/2 



+ c 



J _ I 



+ c 



' dt 

1/2 



j +c{Ej^ \yt-y'^\^dt^ +c(eJ^ 



1/2 



1/2 



\xf\ dt] +C E / Ivn dt] +C 



\ u\ 

Ft -Zt\ 

1/2 



dt 



\Zt\ dt 



By using (8) , (9) , (10) , (17) , (18) and (19), we get 



limp? = 0. 
e^o 



Since gx, hy, Ix, ly and 1^ arc continuous and bounded, the proof is com- 
pleted by letting 6* go to in (29). ■ 
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3.2 Necesseiry optimality conditions for relaixed controls 



Starting from the variational inequality (28), we can now state necessary opti- 
mality conditions for the relaxed control problem {(5) , (6) , (7)} in the global 
form. 

Theorem 11 (Necessary optimality conditions for relaxed controls). Let n he 
an optimal relaxed control minimizing the functional J over 71 and (x'^,y'^, z^^) 
the solution of (5) controlled by fj,. Then, there exist three adapted processes 
{k^ ,p'^ ,P'^) , uniqe solution of the following FBSDE system (called adjoint equa- 
tions) 

{ dk!^ = Hy {t, x'i, yf , , Mt, A;f , pf , P^) dt 

{t, , t/f , 0f , ^Jiu fcr,pr, pn dWt, 

K = hy {y^) (30) 

dp'^ = -Wx it, <, yf, ^r, /xt, fcr,pf , pt) dt + ptdWt, 

such that for every qt &^ (U) 

n {t, xt, 2/f , ^Jiup>i, fcf , Pt) < H {t, xf, y^, z^, qt, k^,pl^, P^) , ae , as, (31) 

where the Hamiltonian H is defined from [0, T] x M" x M™ x Mmxd {^) x P (U) x 
X R" X Mnxd (K) into R by 



n{t,x,y,z,q,k,p,P) = / I (t,x,y, z,a) qt (da) + p b{t,x,a)qt{da) 
Ju JU 

+ P cr{t,x, a) qt {da) + k f{t,x, y, z, a) qt (da) . 

JU JU 

Proof. Since /Cg = hyly^) and pt^ = (x^) + (px (xi^) kl^, then (28) becomes 
< E Ipf^xr] + E [k^yo] - E [^^ {xt^) A;^] + E / I l^ [t, xf , y^, z^, a) XtUt {da) dt 

JO JU 

i-T 



+ E 
+ E 



Ju 
T r 



[ly {t, Xt,yt, a) yt + Iz {t, x'i, yi^, z^, a) Zt] Ht {da) dt 



(32) 



{t,x^,y'i,z'^,a)qt{da)- / l{t,x'^,y^,z^,a) iJ,t{da) 

Ju 



'U JU 

By applying Ito's formula to {ptXt) and {ktyt), we have 

i-T 



dt. 



E \p>^xt] = -E / / {t, xf , , z^, a) fit {da) fcf + [ I, {t, xf , yf , z^, a) fit {da) 
Jo Uu JU 



+ 



e[ p'^l [ b{t,x'^,a) qt {da) - [ b{t, xf , a) fit {da) 
Jo Uu JU 

e/V[/ c 
JO Uu 



dt 



a{t,Xf,a)qt{da) - / a {t , x'^ , a) jit {da) 



dt. 
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E [k^yo] = E [k!^yT] - E 



JU 



ly{t,Xt,yt,z^,a)iJ,t{da)yt+ / U {t,x'^ ,y^ , ,a) Ht (da) Xtk^ 



dt 



ij k^\[ f (t, , yf , z^, a) qt {da) - [ f {t, , , , a) m {da) 
Jo Uu JU 

Jo Ju 



dt 



h {t, a;f , t/f , z^, a) nt {da) Ztdt. 
Then for every q GTZ, (32) becomes 

< E [H {t, yf, z'i, qt, k'i,p>t, Pt) - n {t, , t/f, z^, i^t, K,pl )] dt. 
Jo 

Now, let g e 7^ and F be an arbitrary element of the u-algebra J^t, and set 

TTt = qt'^F + Mtla-F- 

It is obvious that tt is an admissible relaxed control. 
Applying the above inequality with tt, we get 

< E[l^ {H {t, , , z^, q^ k^,p'^, Pt) - U {t, , yf , z^, /it, k^,pl^, Pt)}], VP e J'f 

Which implies that 

< E[n {t, x'i, yf, qt, , Pt) - H {t, x^ yf, z<^, Mt, fcf , Pf) / ^t]. 

The quantity inside the conditional expectation is .?^t-measurable, and thus 
the result follows immediately. ■ 

3.3 SufRcient optimality conditions for relaxed controls 

In this subsection, we study when necessary optimahty conditions (31) becomes 
sufficient. For any q we denote by (a;',y',2;') the solution of equation (5) 
controlled by q. 

Theorem 12 (Sufficient optimality conditions for relaxed controls). Assume 
that the functions g, h and (x,y,z) i — >■ Ti.{t,x,y, z,q,k,p, P) are convex, and 
for any q G TZ, y!^ = ^, where ^ is an m-dimensional J^T-Tneasurable random 
variable such that 

E\Cf < oo. 

Then, fx is an optimal solution of the relaxed control problem {(5) , (6) , (7)}, 
if it satisfies (31) . 

Proof. Let /U be an arbitrary element of TZ (candidate to be optimal). For any 
q gTZ, we have 



J{q)-J (m) =E[g (4) - g (x^)] +E[h (y«) - h {y^)] 



+ E / l{t,x^,y^,z^,a)qt{da) - / I {t, x'^ ,y'^ , z^ ,a) /it {da) 
Jo Uu Ju 



dt. 
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Since g and h are convex, then 



9 {xt) - 9 (a;^) > 5x «) {x\. - xt^) , 



Thus, 



J{q)-J > E [g. (xi^) (4 - 4)] + E [/i, (j/o^) [y'o - y^)] 

+ E / l{t,x1,y^, zl, a) qt {da) - l{t, x'^, y^, z^, a) fit {da) 
Jo Uu Ju 

We remark from (30) that 

Pt ~ 9x {xj') , 
^0 = hy {y^) . 

Then, we have 
J{q)-J {H) > E [pi^ {x}, - x^)] + E [k!^ {yl - y^,)] 
+ E 



dt. 



l{t,x'i,y^,z^,a)qt{da) - / Z (t, a;f ,yf , 2;f , a) /i* (da) 

Ju 

By applying Ito's formula respectively to {x1 — ccf ) and fcf {yl — y^), we 
obtain 

E [p^ (4 - x^)] = -E Ch, {t, xl y'i, Mt, fcr.P^ ^t'') (2^? - x^t) dt 
Jo 

+ E p'^ / b{t,x1,a)qt{da) - / b {t,Xt ,a) iJ,t {da] 
Jo Uu Ju 

+ e[ j a{t,x1,a)qt{da)- [ a{t,x^,a)nt{d< 

Jo VJu Ju 



dt, 



nki;{y'o-y^)] 



{t, x'i, 2/f , z'^, lit, K,Pt, Pt) {yl - yt) dt 

+ e[ k\ [ f{t, xf, yl zl a) qt {da) - f f {t, x^, j/f , , a) {da 
Jo Uu Ju 

- E fn, {t, x^,yi^, z^, fit, K,pI Pt) {z't - dt. 
Jo 
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Then, 

J{q)-J{lA (33) 



>¥.r [H it, xlvl zl qt, k^,pl Pt) ~ n it, yf, z^, i^u K,p^,Pn] dt 
Jo 

~e[ it, x'i, yf, Mt, K,P^, Pt) {xf - x'i) dt 
Jo 

- E it, x^, yt, z't, ixt, K,vt. Pn {y1 - Vt) dt 
Jo 

-e[ it, x'i, y':, z'^, lit, K,p^, pn izt - z>t) dt. 
Jo 



Since Tt is convex in z) and linear in /i, then by using the Clarke gen- 
eralized gradient of H evaluated at ixt,yt, Zt, Ht) and the necessary optimality 
conditions (31), it follows by [50, Lemmas 2.2 and 2.3] that 

^ (t, xl,y1, zl, qt, K,p'i, P^ - T-i it, x'i , , z'^ , jit, K,Pt, Pt) 
> it, xt,y'i, lit, K,p^, Pt) ixl - xt) + Hy it, x'i, yf, ^f, ^t, K,p'i, Pt) (y? 
+ it, yf , z>i, Mt, fcf Pt) izl - z>i) . 

Or equivalently, 

Q<nit,xl, yl, zl, qt, K,pi, Pt) - U it, , yf, z'^, i^t, K,pi, Pt) 

- it, xt, yf , z>i, „t, K,p':, Pt) ixl - x'i) 

- Hy it, xi, y'i, z'i, nt, K,pi, Pt) ivl - y'i) 

- it, xi, yi, zt, Mt, k'i,pi, Pt) izi - zt) . 

Then from (33), we get 

Jiq)-Jili)>^. 

The theorem is proved. ■ 

4 Optimality conditions for strict controls 

In this section, we study the strict control problem {(1) , (2) , (3)} and from the 
results of section 3, we derive the optimality conditions for strict controls. 

Throughout this section and in addition to the assumptions (4), we suppose 
that 

U is compact. (34) 
h, a, f and I are bounded. (35) 
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Consider the following subset of TZ 



S{U) = {qGTl I q = 5, 



vgU}. 



The set 6 (U) is the collection of all relaxed controls in the form of Dirac 
measure charging a strict control. 

Denote by 6 (U) the action set of all relaxed controls in S iU). 

If (/ G (5 iU), then q = 5y with v G U. In this case we have for each t, 
qt^S {U) and qt = 5y^. 

We equipped P {U) with the topology of stable convergence. Since U is 

compact, then with this topology P ([/) is a compact mctrizabic space. The 
stable convergence is required for bounded measurable functions / {t, a) such 
that for each fixed t € [0,T], / (t, .) is continuous (Instead of functions bounded 

and continuous with respect to the pair (i, a) for the weak topology). The space 
P {U) is equipped with its Borcl cr-ficld, which is the smallest cr-ficld such that the 

mapping q i — > j f (s, a) q {ds, da) arc measurable for any boimdcd measurable 

function /, continuous with respect to a. For more details, see Jacod and Memin 
[29] and El Karoui et al [16]. 

This allows us to summarize some of lemmas that we will be used in the 
sequel. 

Lemma 13 (Chattering Lemma). Let q be a predictable process with values in 
the space of probability measures on U. Then there exists a sequence of pre- 
dictable processes (w")„ with values in U such that 



Proof. See El Karoui et al [16]. ■ 

Lemma 14 Let q be a relaxed control and (m")„ be a sequence of strict controls 
such that (36) holds. Then for any bounded measurable function f : [0,T]xU —^ 
M, such that for each fixed t e [0,T], / (t, .) is continuous, we have 



Proof. By (36) and the definition of the stable convergence (see Jacod-Memin 
[29, definition 1.1, page 529], we have 



dtq^ {da) = dtSu^ {da) — > dtqt {da) stably, V — a.s. 



(36) 



where is the Dirac measure concentrated at a single point ofU. 




(37) 




Put 



g{s,a) = l[o,t] {s)f{s,a). 
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It's clear that g is bounded, measurable and continuous with respect to a. 
Then 



g (s, a) du^ {da) ds 



g{s,a) Qs {da) ds. 



10 Ju " ^ Jo Ju 

By replacing g {s, a) by its value, we have 



nf {s,a)du^ {da)ds — > / f {s,a) {da) ds. 

The set {{s,t) ; < s < t < T} generate Sp^r]- Then, for every B e B[q^t] 
we have 

/ / / (s, a) 5u^ {da) ds — > f {s, a) Qs {da) ds. 

JbJu n^oo Jgjjj 

This implies that 

f {s, a) Sun {da) — > f {s,a) {da) , dt-a.e. 

Ju n^oo Jjj 

The lemma is proved. ■ 

The next lemma gives the stability of the controlled FBSDE with respect to 
the control variable. 

Lemma 15 Let q € TZ be a relaxed control and {x"^ , y'^ , z"^) the corresponding 
trajectory. Then there exists a sequence C U such that 



lim E 

n— '■oo 



lim E 



sup Ix^-xff 
te[o,T] 



sup \yt-y?f 



= 0, 



te[o,T] 



lim / Elzi;- -zlfdt = 0, 



(38) 
(39) 
(40) 



lim J («") = J{q). (41) 

n— >oo 

where (a;", y", 2;") denotes the solution of equation (1) associated with u". 
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Proof. Proof of (38). We have 



b{s,x:,u:) 



[ b{s,xl 
Ju 



a) Qs (da) 



+ C [ E (7(s,x^,0- / ais,xla)qs{da) 
Jo Ju 

<c(\\h {s, x^, <) - h {s, x1, u:)f ds 
Jo 



ds 



ds 



+ C I E 

D 



b{s,x1,u'^)- / b{s,x1,a)qs{da) 



ds 



+ C f E\a{s,x':,u^)-a{s,x1,u^)fds 
Jo 

+ C I'e a{s,xlu:)- I a{s,xla)q,{da) 
Jo Ju 

Since b and a are uniformly Lipschitz with respect to x, then 



ds 



E\x7-x^f < C 



x'ifds 



Jo 

b{s,x%u^^)- / b{s,xl,a)qs{da) 
Ju 

+ C E / a {s,x^,a) Sun (da) — / a {s,x1,a) qs {da) 
Jo Ju " Ju 



+ C E 
Jo 



ds 



ds 



Since b and a arc bounded, measurable and continuous with respect to a, 
then by (37) and the dominated convergence theorem, the second and third 
terms in the riglit hand side of the above incquahty tend to zero as n tends to 
infinity. We conclude then by using Gronwall's lemma and Bukholder-Davis- 
Gundy inequality. 

ii) Proof of (39) and (40). 
We have 



[ Vt-Vt 
Put 



- [/ (t, xr, yr, z^, <) - / (t, xr, yi zi o] dt 

- f (t, x^,yl^ . <) - / (t, xlyl zl <)] dt 

- f (i, xf , ?y;' ,zlu^)-Jf {t, xl , y1 , , a) qt {da) 

+ [z^-z1)dWu 

LP {X^) - LP {x'ip) . 



dt 



yr = vt - yi 
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and 



{t, y,", Z^) = - [/ [t, x^, yl zl <) - / (i, xf, vl zl <)] dt (42) 

- f{t,xlylzlu^)- / f{t,xlylzla)qt{da) 

Ju 

- [ fv it, xlyl + A (yr - vt) , + A (^r - ^1) , O ^^"'^A 

JO 

- / /z (i, a;^, + A (y," - y|) , z« + A (4' - zl) , Zl^dX. 
Jo 



Then 



(43) 



The above equation is a Unear BSDE with bounded coefficients, then by 
applying a priori estimates (see Briand et al [12]), we get 



E 



sup \Yrf+ [ \Z^fdt 
te[o,T] Jo 



Prom (42), we get 



< CE 



< CE 



|(^(x?;)-(^(4)r + 



\^{x^)-^{x'^)\' 



f 

Jo 



I*" {t,0,0)\dt 



I*" {t,0,0)fdt 



E 



sup \Yrf+ f\Z^\ 
te[o,T] Jo 



dt 



< CE|(^(a;?.) -(^(a;f,)|^ 

+ CE r 1/ {t, x^, yl zl vll) - f {t, xl yl zl <) f dt 
Jo 

i 

Jo 



+ CE 



f (t^xlylzlul) - / f {t,xlylzla)qt{da) 



dt. 



By (4), if and / are uniformly Lipshitz with respect to x, then we get 



E 



sup / \Z^fdt <CE\x^-x^T.f + CE [ \x'^ 

te[o,T] Jo Jo 



xl^dt 



+ CE 



f {t, xl yl zl a) Su^ (da) - f {t, xl yl zl a) qt (da) 



u 

By (38), the first and second terms in the right hand side of the above 
inequality tends to zero as n tends to infinity. Moreover, since / is bounded, 
measurable and continuous with respect to a, then by (37) and the dominated 
convergence theorem, the third term in the right hand side tends to zero as n 
tends to infinity. This prove (39) and (40). 



dt. 
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iii) Proof of (41) . 

Since g ,h and I are uniformly Lipshitz with respect to {x,y,z), then by 
using the Cauchy-Schwartz inequality, we have 

<c(e \xT^ - 41') + c(e I2/0" - y'of) 

1/2 / „-r \ 1/2 



'{t,x'l,y1,zl,a)5u^{da)dt- / l{t,x'l,y1,zl,a)qt{da 

Ju 



U 

u 



1/2 



By (38), (39) and (40) the first five terms in the right hand side converge to 
zero. Furthermore, since h is bounded, measurable and continuous in a, then by 
(37) and the dominated convergence theorem, the sixth term in the right hand 
side tends to zero as n tends to infinity. This prove (41). ■ 

Lemma 16 As a consequence o/(41), the strict and the relaxed control problems 
have the same value functions. That is 

■mU {v) = MJ (q) . (44) 

Proof. Let u gU and GTZhe respectively a strict and relaxed controls such 
that 

J{u)=mU{v) (45) 
J in) = mi J {q). (46) 

By (46), we have 
Since 5 {U) C Tl, then 

J{^^)<J{q),yq&5{U). 

Since q€: 5 {U), then q = 6v, where v gU. 
Then we get 

(a;9,^/«,z9) = (a;^2/^z'^), 
J{q) = Jiv). 

Hence, 

J{p)<J (v) , Vw e W. 

The control u becomes an element of U, then we get 

J{t^)<J{u). (47) 
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On the other hand, by (45) we have 



J{u)<J [v) ,yv&U. 



(48) 



The control ji becomes a relaxed control, then by lemma 13, there exists a 
sequence (w")^ of strict controls such that 



By (48), we get then 

J{u)<J (m") , Vn G N, 
By using (41) and letting n go to infinity in the above inequality, we get 



Finally, by (47) and (49), the proof is completed. ■ 

To establish necessary optimality conditions for strict controls, we need the 
following lemma 

Lemma 17 The strict control u minimizes J over U if and only if the relaxed 
control fj, — du minimizes J over TZ. 

Proof. Suppose that u minimizes the cost J over U, then 



dt/j.? {da) = dtSuf (da) — > dtjit (da) stably, V — a.s. 



J{u) < J{ij). 



(49) 



J{u) = inf J(t;). 



By using (44), we get 



J{u) = mi J 



qen 



Since ii = 5u, then 




(50) 



This implies that 

J(M)=inf J(g). 



Conversely, if = i5„ minimize J over It, then 



J(/x) =inf J(g). 



From (44), we get 



J(n)=m{J(v). 



24 



Since = 6u, then relations (50) hold, and we obtain 

J{u) = miJ{v). 
veu 

The proof is completed. ■ 

The following lemma, who will be used to establish sufficient optimality 
conditions for strict controls, shows that we get the results of the above lemma 
if we replace TZhy S (U) . 

Lemma 18 The strict control u minimizes J over U if and only if the relaxed 
control n = Su minimizes J over ^ (U) . 

Proof. Let /U = (5„ be an optimal relaxed control minimizing the cost J over 
S {U), we have then 

J{li)<J{q), yqeS{U). 

Since q £ 5 {U), then there exists v gU such that q = 5y. 
It is easy to see that 

{x<i,yi,z") = {x\y\z-), 
J{q) = J{v). 

Then, we get 

J{u)<J{v), VveU. 

Conversely, let m be a strict control minimizing the cost J over U. Then 

J{u)<J {v) , Vt; G W. 
Since the controls u,v &U, then there exist fi,q G S {U) such that 

M = , q = Sy. 
This implies that relations (51) hold. Consequently, we get 

J{l^)<J{q), yqed{U). 
The lemma is proved. ■ 

4.1 Necessary optimality conditions for strict controls 

Define the Hamiltonian H in the strict case from [0, T] x R" x xMmxd (R) x 
[/ X X K" X Mnxd (K) into M by 

H {t,x,y,z,v,k,p,P) = l{t,x,y,z,v) +pb {t, x,v)+Pa {t, x, v)+kf {t,x,y,z,v). 
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Theorem 19 (Necessary optimality conditions for strict controls). Let u be an 
optimal control minimizing the functional J overU and the solution 

of (1) associated with u. Then, there exist three adapted processes {p^^ , , k^^) , 
unique solution of the following FBSDE system (called adjoint equations) 

' dk^ = Hy {t, x^, , , ut, k^,p^, pr) dt 

+H, (t, x'i, v^, z^, ut, k^,pX, Pn dWt, 
< fco«= hyiyl^) (52) 
dp^ = -H,,{t, x^, y^, zj, uu klt,p^, pn dt + P^dWu 

such that for every Vt gU 
H {t, x^t, yt". fct",Pr. A") < H {t, x^t, y«, zl^, Vt, K,pt, P^) , ae , as. (53) 

Proof. Let u be an optimal solution of the strict control problem {(1) , (2) , (3)}. 
Then, there exist n e S{U) such that 

A* = ^M- 

Since u minimizes the cost J over U, then by lemma 17, /U minimizes 
over IZ. Hence, by the necessary optimality conditions for relaxed controls 

(Theorem 11), there exist three unique adapted processes {k^,p^,P^), solution 
of the system of relaxed adjoint equations (30) such that, for every (/f £ P {U) 

n {t, , , Mt, pn < n {t, x>^, , z^, qt, k^,pl ) , a.e, a.s. 

Since d {U) C P {U), then for every Vt G S {U), we get 

n {t, t/f , z^, Mt, fcf , pn < n {t, yf , z^, qt, kf^,?^, Pn , a.e, a.s. (54) 

Since q G S (U), then there exist v gU such that q — Sy. 

We note that v is an arbitrary element of U since q is arbitrary. 

Now, since ij. = 6u and q = 5y, we can easily see that 

(x'',y'',z'') = (a;",y",z"), 
(x«,y«,z«) = (x^y^z''), 

(fc'',p^,P'^) = (A;",p",P"), (55) 

n {t, xi yf , , tiuK,pi pn = H (t, yr, u,,k^,p^, pn , 
_ n {t, x^, yr, , qt, K,p^t. Pt) = H it, xt, yr, z^ , vt,k]^,p:t, pn , 

where, the pair {p^,P'^) and fc" are respectively the unique solutions of the 
system of strict adjoint equations (52). 

Finally, by using (54) and (55), we can easy deduce (53). The proof is 
completed. ■ 
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4.2 Sufficient optimaUty conditions for strict controls 

Theorem 20 (Sufficient optimality conditions for strict controls). Assume that 
the functions g, and {x, y, z) i — > H {t, x, y, z, q, k,p, P) are convex, and for any 
V G U, y'^ = ^, where (, is an m- dimensional J^t -measurable random variable 
such that 

E\Cf < oo. 

Then, u is an optimal solution of the control problem {(1) , (2) , (3)}, if it 
satisfies (53) . 

Proof. Let w be a strict control (candidate to be optimal) such that necessary 
optimality conditions for strict controls (53) hold, i.e, for every Vt G U 

H{t,xlyr,zr,Uukr,p^,Pn<H{t,xly^,zi^,vt,k^,p^,Pn, a.e, a.s. (56) 
The controls u, v are elements of U, then there exist iJ,,q € 6 (U) such that 

A* = Su, 
q = 5y. 

This implies that relations (55) hold. Then by (56), we deduce that for every 

qt e 6 (U) 

H it, x^, yt, zit, fxt, ki;,p^, Pt) < n [t, x^, , z^, qt, ki^,p^, Pf) , a.e, a.s. 

Since H is convex in (x, y, z), it is easy to sec that 71 is convex in [x, y, z), 
and since g and h are convex, then by the same proof that in theorem 12, we 
show that /X minimizes the cost J' over 6 iU). Finally by lemma 18, we deduce 
that u minimizes the cost J over U. The theorem is proved. ■ 

Remark 21 The sufficient optimality conditions for strict controls are proved 
without assuming neither the convexity ofU nor that of H in v. 
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